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A Missing Link in Our 
Appreciation of Teaching 
Quality and Equity 


Ask any parents what they hope for their 
children's education and teachers will quickly 
emerge in the conversation. Whatever else 
might be happening in schools, parents hope 
their children will have the good fortune of 
capable and caring teachers. Research has 
recently caught up with such common sense: 
Teachers matter a great deal. In fact, existing 
research demonstrates that of all the 
schooling-related resources that account for 
student academic learning, the quality of 
teachers matters most. 


Parents also recognize that learning is 
something that takes place over time. They 
can see the gradual growth of knowledge and 
skill in their children, the most visible product 
of teachers’ work. Children need not one or 
two quality teachers during their years of 
schooling but a steady succession of them 
whose efforts combine over time to support 
children's growth and development. The 
effects of schooling are cumulative, and so 
are the effects of teachers. So what matters 
for all children is the trajectory of their 
learning and development. 


In the best of worlds, all children benefit from 
a succession of quality teachers, but the sad 
fact is that only some have such access. 
Massive inequalities in access to quality 
teachers is a prominent feature of schooling 
in America. The children least likely to have 
quality teachers are those who need them 
most—children of color, those from low- 
income families, and those learning to speak 
English.“ 


But this national narrative of inequitable 
access to quality teachers overlooks a critical 
part of the story. There is a missing link 
regarding the connection of students to 
teachers. From a learning perspective, that 
critical link is the quality of instruction that 
students receive. It matters who teachers are, 


but it matters even more what they do in 
their interactions with students and the 
subjects that students are learning. 


Contemporary scholarship on teaching 
reflects this point. For example, research on 
observations of teaching shows that the 
same teacher may provide different levels of 
teaching quality, depending on the students 
who are in the room.® An older tradition 
focusing on teachers is giving way to a much 
broader emphasis on (1) what teachers do, 
(2) their interactions with students, (3) the 
content and goals of education, and (4) 
specific school and community contexts. 
These four features shape the crucible of 
learning, sometimes referred to as 
instruction. 


Equity enters this portrait of teaching as well. 
On the one hand, we have clear and 
compelling evidence about the distribution of 
teacher qualifications, contributing toa 
powerful story of inequity.'° A robust set of 
indicators related to teacher characteristics 
has been shown to be inequitably distributed 
across students, including years of 
experience, certification status, and others. ' 
"2°13 14 On the other hand, we have cae 
student learning in a variety of ways, 
documenting in recent years how uneven 
and unequal achievement is among student 
groups. ~ However, in terms of the emerging 
focus that takes the four critical features into 
account, we have little corresponding 
evidence about the distribution of instruction 
itself.'° We know that teaching varies in its 
instructional effectiveness, but we have not 
mapped how that variation relates to 
students’ varying backgrounds. In the K-12 
school context, we have no trustworthy 
indicators of teaching itself to guide 
policymaking.’ In addition to equity 
concerns, the absence of instructional 
indicators makes it challenging to improve 
teaching quality in a systematic fashion. 


From a policy perspective, then, we have an 
inadequate account of the teaching-learning 
process that relies just on inputs and 
outcomes. In other spheres of American life, 
a much richer set of indicators measures and 
models critical processes. Health care is a 
prime example, as is regulation of the 
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economy, but advancements have been 
made in many fields. We cannot guide the 
pursuit of educational quality or educational 
equity absent an understanding of how 
learning is achieved through the interactions 
of teachers and students—in the classroom, 
around worthwhile content. 


To address this missing link, we propose the 
development of indicators of teaching 
quality. Indicators, as we next describe, must 
meet certain criteria; they have proven to be 
an important resource in other fields as we 
describe in the area of health care. To assess 
the standing of indicators in education, we 
analyze existing indicators used in major 
surveys administered by the federal 
government. We conclude with thoughts 
about the future of indicators for teaching. 


On Indicators 


Indicators are a familiar idea, commonplace 
today in many walks of life, used by the 
public and policymakers to inform many 
kinds of decision-making. The idea of an 
indicator is simple. It is a statistic or 
combination of statistics designed to gauge 
progress toward some important end or 
outcome. Indicators differ from "mere" 
statistics in that they serve as the object of 
policymaking and can provide some valued 
direction. 


For example, in the field of economics, the 
unemployment rate is a critical indicator of 
economic functioning. Policymakers attend 
carefully to this indicator as an outcome of 
interest and as one gauge of economic and 
social policies. In the health-care field, 
hospitals carefully track mortality and 
morbidity rates in response to treatments, 
while individual patients might select 
physicians to perform a surgery based on the 
number of such procedures the physician 
has performed. Indicators then can be used 
by consumers and professionals, individuals 
and organizations, and policy systems at 
local, state, and national levels. 


Indicators have two broad uses. One is to 
track the status of some important value. 
Policymakers want to know, for example, 


about trends in student learning in the 
United States. The National Assessment of 
Educational Progress (NAEP) provides such 
vital information about student academic 
achievement in key subject areas at multiple 
grade levels. The other purpose for an 
indicator is to aid in explanation. When 
multiple indicators are available, the 
combined information assists in identifying 
and interpreting trends of importance to 
policymakers. 


Complexities arise when indicators are used 
for explanation and interpretation because 
they must rely on theory and evidence of 
some kind to support a claim about causal 
links—how "X is related to Y." The stronger 
this relationship, the greater confidence we 
have in the indicator. 


Good indicators meet certain well- 
established criteria.'® Ideally: 


* They rest on evidence that the activity 
monitored by an indicator is related to the 
production of valued outcomes. 

* The collection and reporting of information 
on the activity does not lead to undesirable 
responses. 

* They are minimally burdensome on those 
who supply the information. 

* They are cost efficient. 

* The information categories used are likely 
to be meaningful for a foreseeable future 
timeline, for example, the next 15 years. 


In light of the growing recognition of the 
importance of teaching quality and its 
provision to all students, indicators may be 
one useful tool for addressing persistent 
inequalities in U.S. students' outcomes. This 
brief offers an argument for such indicators 
drawing on the model used in the health-care 
field. This case demonstrates the utility of a 
framework that combines three types of 
indicators—referred to as "structural," 
"process," and "outcomes" (described 
below)—to gauge the overall quality of health 
care. When we examine the measures of 
teaching drawn from federal surveys that are 
designed to collect information at the teacher 
level, we find almost no measures that track 
the quality of the instructional process itself. 
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Structural and outcome measures abound 
with no corresponding attention to process 
measures. Our recommendation is to begin 
exploring prospects for developing such 
measures that might yield a more 
comprehensive accounting of educational 
quality and its provision to all students. 


Indicators of Health Care 


For many decades, leaders in the health field 
have worked on defining and measuring 
quality of care. While disagreement exists, a 
general model, introduced to the field years 
ago, has proven durable and is widely used. 
The "Donabedian model," named after its 
author, parses the assessment of health care 
into structure, process, and outcomes.” 
Structure denotes attributes of the settings in 
which care occurs. These may include 
material, human resources, or organizational 
features associated with settings. Process 
indicators denote what is actually done in 
giving and receiving care, including both 
patient and practitioner activities. Outcomes 
refer to effects of care on health status (e.g., 
mortality and morbidity rates) while also 
including changes in patient knowledge and 
behavior together with their satisfaction with 
the care provided. 


An important point here is that this three- 
part approach is possible only because, as 
Donabedian (1988) has written, "good 
structure increases the likelihood of good 
process, and good process increases the 
likelihood of good outcomes. It is necessary, 
therefore, to have established such a 
relationship before any particular component 
or outcome can be used to assess quality" 

(p. 1745). 


There are two sources of validation for 
measures of quality, associated with a logic 
of correlation or logic of correspondence. 
Ideally, criteria and standards for structural, 
process, and outcome indicators are based 
on sound, scientifically validated knowledge. 
Claims for indicators rest on their 
demonstrated association with valued 
outcomes, either directly or as mediated by 
process measures. Indicators must correlate 
with important factors. A causal logic based 
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on association or correlation among 
measures is the desired standard. But in 
cases where such knowledge is not available, 
Donabedian writes, criteria and standards 
"should represent the best informed, most 
authoritative opinion on any particular 
subject. Criteria and standards can also be 
inferred from the practice of eminent 
practitioners in a community. Accordingly, 
the criteria and standards vary in validity, 
authoritativeness, and rigor." ° This second 
logic, then, rests on a claim of correspond- 
ence with best practice and the collective 
judgment of experts. 


This model has provided the basis for a 
considerable set of indicators in the medical 
field, applying to a wide range of health 
professionals and institutions. The field relies 
on all three kinds of measures because each 
is important in evaluating cases of different 
kinds. 


Before applying these ideas to teaching, it is 
important to note that the specific aspects of 
health quality being tracked and the purpose 
of the indicator are important. For example, 
for procedures that are high risk and 
relatively uncommon, structural measures 
are the preferred option because the 
procedures are performed too infrequently 
to support direct outcome measurement. In 
such cases, procedure volume—a structural 
measure—is likely the only practical quality 
indicator. 


In cases of low risk and frequent health 
outcomes, process measures and patient- 
centered outcomes have the greatest 
advantages, typically risk-adjusted measures 
of morbidity and mortality. For such 
procedures, volume and other structural 
measures are not known to be major 
determinants of outcomes. Quality is best 
judged by process measures (where 
available) and by outcome measures such as 
functional health status that extend beyond 
morbidity and mortality rates. 


The knowledge base for indicators in 
medicine is robust and steadily expanding. 
Indicators have proven to be a useful tool for 
managing health care, even as they involve 
limitations of various kinds and cannot be 
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applied with equal validity to all aspects of 
medical care. All three types of indicators 
have value and all are used in evaluating 
health care. 


This brief excursion into the medical field 
prompts the question whether parallel 
possibilities present themselves in teaching. 
An analysis of one significant sample of 
teaching indicators demonstrates where the 
emphasis has been placed among the three 
types of indicators—and where gaps appear 
that may be leveraged to address the 
instructional inequalities across our nation's 
classrooms. 


Federal Measures and 
the Quest for Quality 


Given its utility in medicine, we now apply the 
three-part logic of "structure-process- 
outcome" to the practice of teaching. The 
federal government spends thousands of 
dollars every year collecting important 
indicators of teaching and learning through 
questionnaires of various kinds. This 
represents the most systematic national data 
we have on teaching. To determine whether 
and how these federal measures provide 
insight into the process of teaching quality, 
we collected and analyzed the primary 
ongoing measures the federal government 
employs to track trends in relation to 
teachers and teaching: teacher surveys 
administered by the National Center for 
Education Statistics (NCES)." 


In the United States, the states have 
constitutional responsibility for education, 
coupled with a strong tradition of local 
control. States have responsibility for 


managing their teacher workforce through 
the labor market, determining education 
funding formulas, and teacher evaluation 
efforts, while the federal government has the 
mandate to conduct educational research, 
which has included the sponsorship of large- 
scale surveys and other information- 
gathering activities. Since there is no 
systematic way to look across state-level data 
except by collecting it state by state, we focus 
on a federal sample of surveys because it is 
the data that policymakers most likely can 
use to learn in a timely, systematic way about 
teaching quality across the nation. 


Surveys of teachers accompany many of the 
large-scale assessments of student 
achievement that the NCES has sponsored, in 
addition to one standalone survey of 
teachers and principals, the National 
Principal and Teacher Survey (hereafter, we 
refer to questionnaires administered to 
teachers as "surveys" and the programs 
collecting information on student 
achievement as "assessments.") 

We downloaded these surveys from 

the NCES website, then reviewed them to 
form our initial categories. See Appendix C on 
the NCES website for the complete list. 


In examining these potential sources for 
teaching quality indicators, we adopted the 
definitions of the three kinds of measures 
from the health-care field to explore this 
question: What proportion of items might be 
classified as structure, process, or outcome 
indicators? 


Figure 1 summarizes the distinctions we used 
to organize the analysis of constructs and 
items included in this sample of surveys 
sponsored by the NCES. 
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Figure 1: Sorting and Classification of Indicators from Federal and International Surveys 


Structure <quump 


TEACHER CHARACTERISTICS 
+ Employment status 

* Associational membership 
* Teacher demographics 


TEACHER CERTIFICATION AND 

KNOWLEDGE 

+ Degree/certificate/name of 
university graduated from; 
undergraduate courses on 
teaching; taken tests; 
teacher induction program; 
alternate certification 
program; preparedness to 
use computer/variety of 
instructional methods/data; 
certified by the National 
Board for Professional 


Teaching Standards; Highly 
Qualified Teacher (HQT) 
according to state's 
requirements 


TEACHER BELIEFS 

* Job satisfaction 

* School environment 

* Beliefs about students 

* Beliefs about practice 
TEACHER IN-SERVICE 
EXPERIENCE 

+ Development experience 
* Job evaluation 


SCHOOL CHARACTERISTICS 
STUDENT CHARACTERISTICS 


ProcesS  <qum» Outcome 


TEACHING PRACTICE 1. STUDENT ENGAGEMENT 


Discussion of student + Attendance 
performance/learning * Problems in school: 
Homework assignment absenteeism, dropouts 
frequency 

Time spent in library 

Approach for students who 

fall behind 

Time spent on different 

activities by children 

Emphasis on information 

and communication 

technologies (ICT)-based 

capabilities in students 

Emphasis on tools such as 

digital learning games, 

graphing, or drawing 

software 

Different collaboration 

methods 

Usage of computers for 

English/Language Arts 

Specific practices for 

reading and math 

Pedagogical approach to 

reading, writing 

Methods of student 

assessment 

Emphasis on cognitive 

processes/social skills 


TEACHING ASSIGNMENT 


Hours spent on teaching 
Activity spent most time 
teaching in 


Note: Names of constructs are numbered and listed in boldface. 
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The process of classifying items based on 
these distinctions took place in several steps. 
First, we organized the items in these surveys 
according to hypothesized constructs. For 
example, the construct identified as "teacher 
characteristics" included items that asked 
teachers for their employment status, 
demographic descriptors, and participation in 
teacher organizations, such as one of the two 
major teacher unions. 


Then, one member of our team reviewed and 
classified all of the items as either structural, 
process, or outcome. To provide a check of 
inter-rater agreement, a second member of 
our team classified all of the items according 
to our distinctions. This yielded agreement 
on 99 percent of the items. Disagreements 
were reconciled and final classifications 
reflect that reconciliation. 


Across all of the surveys, we identified 79 
items that measure 9 constructs. Figure 2 
presents the results. Of the 79 items in this 
sample, 61 were structural, 15 were process, 
and only 3 were outcomes, featuring certain 
nonacademic measures. Appendix A arrays 
these items by indicator type and rationale 
for inclusion. 


We offer several observations about these 
federal surveys. First, measures of academic 
achievement outcomes are most prominent 
in the large-scale assessments sponsored by 
the NCES. Based on such projects as NAEP, 
PISA (Programme for International Student 
Assessment), TIMSS (Trends in International 
Mathematics and Science Study), and others, 
we have a rich body of knowledge about the 
academic outcomes of schooling that 
provides for a range of comparisons with 
respect to subject matter, jurisdictions (e.g., 
states), and student groups. In terms of the 
Donabedian model, then, there has been 
considerable emphasis on the outcomes of 
teaching in terms of academic learning. At 
the same time, these projects limit attention 
to academic outcomes that can be measured 
at scale. We know much less about a broader 
range of outcomes that encompass, for 
example, social and emotional aspects of 
learning. 


Structural aspects of teaching have also 
received attention in the teacher surveys. 
Indicators such as years of experience, 
certification status, out-of-field teaching, and 
others are valuable to track, serving as weak 
proxies for student learning. But as we 
hypothesized, there are few measures of 
process with respect to teaching. Figure 2 
reveals that over three quarters of all items 
on the teacher surveys referred to some 
structurally related factors. Appendix B 
provides the number and percent for each of 
the items. 


There are also very few outcome measures 
on these surveys. This is sensible because 
outcome measures of instructional quality 
usually come in the form of assessments of 
student learning. These are most often 
measures of academic achievement, 
frequently assessed on cyclical, federal, large- 
scale student data collections such as NAEP 
and PISA. 


Figure 2: Distribution of Federal Potential 
Indicators According to Donabedian Model 


80 TH.2 


Percentage of Indicators 


0 _—_—_ 


Structure Process Outcome 


In terms of the Donabedian model, then, 
constructs and items from these teacher 
surveys include minimal attention to teaching 
process, confirming a missing link between 
structural or input features and the 
measures of academic achievement included 
on the large-scale assessments. 


A range of considerations explains this 
absence. Locating indicators of teaching 
process that meet the criteria set out above 
will offer challenges. Direct observation is 
one option but carries with it the obvious 
problems of expense, intrusiveness, and 
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technical adequacy. Other indicators based, 
for example, on teacher and student surveys 


may be weak proxies for instructional quality. 


Forming a consensus on a single set of 
measures that bears some predictive relation 
to student outcomes will surely be both a 
political and scientific challenge. But without 
process indicators, we lack crucial 
information of use in educational 
policymaking. We need to track trends in 
student achievement over time and in 
comparison with other countries, but we also 
need information to interpret the trends and 
to assist in explaining patterns in the 
outcome data. At present, such information 
is severely limited. 


There have been prior efforts to identify a 
potential set of measures, but none recent 
enough to capitalize on the contemporary 
growth of knowledge about teaching 
effectiveness. We argue, then, that renewed 
attention to indicators of teaching quality is 
urgent, particularly from the perspective of 
equity. Already, a significant body of 
evidence, oriented largely to teacher 
qualifications, has demonstrated how 
inequitable the distribution of teachers is, to 
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the detriment of the many historically 
underserved students in our country. The 
real question, though, concerns whether all 
students are receiving high-quality 
instruction. It's the teaching that matters. 
What matters is what happens between 
teachers and students in pursuit of the 
crucial goals of learning as they encompass 
knowledge and skills, as well as social and 
emotional outcomes. 


We conclude by issuing a call for work on this 
most critical policy issue despite its challenge. 
We believe a good start can be made based 
on recent advances in our understanding of 
teaching effectiveness and of methods for its 
measurement. Once a Set of such indicators 
has been developed and trialed, it may be 
progressively refined as our knowledge of 
teaching continues to grow. Most 
importantly, though, such indicators will 
provide tangible commitment to the core 
ideals undergirding the American 
Dream—that all children be provided with 
the intellectual means for achieving a good 
life and contributing to our democracy. We 
need an enriched set of policy tools to pursue 
this ideal, and now is the time to start. 
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Appendix A: Indicator Type and Other Details 


Abbreviations: CCD: Common Core of Data; ECLS: Early Childhood Longitudinal Study; HSLS: 
High School Longitudinal Study; ICILS: International Computer and Information Literacy 
Study; MGLS: Middle Grade Longitudinal Study; NAEP: National Assessment of Educational 
Progress; NTPS: National Teacher and Principal Survey; PIRLS: Progress in International 
Reading Literacy Study; PISA: Programme for International Student Assessment; SASS: 
Schools and Staffing Survey; TIMSS: Trends in International Mathematics and Science Study 


Table A-1: Indicator Type, Associated Constructs, Specific Items, and Rationale 
Takelcersh ne) a Data Sources 


Structure (This includes the attributes of material resources, human resources, and organizational 
structure.) 


Teacher Characteristics: 
Rationale/Logic — Aspects of teachers' working conditions pattern affect their work and interactions with students and her 
professionals. 


1. Employment Status 


Regular/full-time/part-time teacher SASS, PISA, ECLS 
Teacher experience/years worked SASS, NTPS 
Field/subject area taught in SASS, NTPS 

2. Associational Membership 
Member of teacher's union SASS, NTPS 

3. Teacher Demographics 
Gender SASS, NTPS, ECLS, HSLS, CCD, ICILS 
Marital status SASS, NTPS, ECLS, HSLS, CCD, ICILS 
Race SASS, NTPS, ECLS, HSLS, CCD, ICILS 
Age SASS, NTPS, ECLS, HSLS, CCD, ICILS 


Teacher Certification and Knowledge: 
Rationale/Logic — A teacher's knowledge and preparation experience influence his or her interactions in classrooms with students, 
thereby contributing to the processes and outcomes of teaching practice. 


Degree SASS, NTPS, PISA, ECLS, HSLS, MGLS, CCD 
Certificate SASS, NTPS, PISA, ECLS, HSLS, MGLS, CCD 
Name of university SASS, NTPS, PISA, ECLS, HSLS, MGLS, CCD 
Graduate/undergraduate courses on teaching SASS, NTPS 

Taken tests (Praxis I/II) SASS, NTPS 

Teacher induction program SASS, NTPS 

Alternate certification program SASS, NTPS 

Preparedness to use computer SASS, NTPS 

Variety of instructional methods SASS, NTPS 

Use of data SASS, NTPS 

Certified by the National Board for Professional Teaching SASS, NTPS 

Standards 

Highly qualified teacher (HQT) according to state's SASS, NTPS 


requirements 
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Table A-1: Indicator Type, Associated Constructs, Specific Items, and Rationale (Cont.) 


Takelcersh ne) a Data Sources 


Teacher Beliefs: 
Rationale/Logic — Teachers' beliefs about their jobs, their schools, students, and the specific content they teach shape how they 
interact with students as well as the school community, thereby influencing both process and outcome indicators. 


1. Job Satisfaction 


Feelings about profession SASS, NTPS, NAEP, PISA, ECLS 
2. School Environment 
Teacher influence SASS, NTPS, ECLS 
School support SASS, NTPS, ECLS 
School climate ECLS 
Belief about other teachers/principals MGLS 
Instructional leadership MGLS 
3. Beliefs about Students 
Teachers' expectations for student achievement TIMSS 
Teaching limitations HSLS 
Opinions about student learning HSLS 
Family background and student learning HSLS 
4. Beliefs about Curriculum and Instruction 
Material, curriculum TIMSS 
Different assessment strategies TIMSS 
Influence over teaching techniques ECLS 


Teacher In-Service Experience: 
Rationale/Logic — Supports for teacher learning directly enhance the human resources directed to instructional quality and interactions 
with students. 


1. Professional Development Experience 


Participation in professional development activities SASS, NTPS, ICILS 
Master/mentor teacher assigned by school SASS, NTPS 
Hours spent in workshops/seminars ECLS 
Sharing of teaching experience, improving topic PIRLS 

2. Job Evaluation 
Frequency of informal evaluation SASS, NTPS 


Salary and Benefits: 
Rationale/Logic — Compensation-related items provide one form of incentive that motivates teachers' work. 


Base salary/total salary CcD 
Outside sources of income SASS, NTPS 
Retirement pension check paid from a teacher retirement SASS, NTPS 
system 

Reimbursement for travel expense SASS, NTPS 
Hours paid to deliver instruction SASS, NTPS 
Hours required to work to receive base pay SASS, NTPS 
Additional compensation from school for extracurricular SASS, NTPS 
activities 

Additional compensation based on student performance SASS, NTPS 
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Table A-1: Indicator T 


pe, Associated Constructs, Specific Items, and Rationale (Cont.) 
Takelcershne) a 


Data Sources 


School Characteristics: 


Rationale/Logic — School characteristics identify features of the context that influence aspects of teachers' work, including motivation, 


capacity, supports, and interactions with students. 
Public/private school 

School system offers tenure 
School capacity 

Teacher observation 

Teacher collaboration 

Teacher engagement 

Assistance from paid aides 
Physical education involvement 
Aspects of remedial help in school 
Class size 


Student ever threatened to injure/physically attack 


SASS, NTPS 
SASS, NTPS 
PISA, ECLS 
PISA 

PISA 

PISA 

ECLS 

ECLS 

HSLS 
MGLS 
SASS, NTPS 


Student Characteristics: 


Rationale/Logic — Characteristics of students exert individual and collective influence on interactions among students and with 


teachers. 
Students in individualized education program (IEP) 


Limited English proficiency or English language learners 
(ELLs) 


Percentage of students not prepared for material 


Average number of students taught 


SASS, NTPS 
SASS, NTPS 


HSLS 
SASS, NTPS 


Process (Denotes what is actually done in providing instruction) 


Teacher Practices: 


Rationale/Logic — These practices occur inside classrooms between and among teachers, students, and content. 


Discussion of student performance/learning 
Homework assignment frequency 

Time spent in library 

Approach for students who fall behind 

Time spent on different activities by children 


Emphasis on information and communication technologies 
(ICT)-based capabilities in students 


Emphasis on tools, such as digital learning games, graphing, 
or drawing software 


Different collaboration methods 

Usage of computers for English/Language Arts 
Specific practices for reading and math 
Pedagogical approach to reading or writing 
Methods of student assessment 


Emphasis on cognitive processes/social skills 


NAEP 
TIMSS 
PIRLS 
PIRLS 
ECLS 
ICILS 


ICILS 


NAEP 

SASS, NTPS, ECLS 
PIRLS, TIMSS, MGLS 
NAEP 

NAEP, ECLS 

NAEP 
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Table A-1: Indicator Type, Associated Constructs, Specific Items, and Rationale (Cont.) 
Takelcersh ne) a Data Sources 


Teaching Assignment: 
Rationale/Logic — These measures supply broad characterization of interactions between teachers and students in classrooms. 


Hours spent on teaching SASS, NTPS, PIRLS, TIMSS 
Activity spent most time teaching in ECLS 


Outcome (Denotes the effect of education on the status of students and population) | 


Student Engagement: 
Rationale/Logic — This group reflects the student outcome measures contained in the questionnaires that may be influenced by various 
structural and process measures in a school/community. 


Attendance MGLS 
Absenteeism SASS, NTPS 
Dropouts SASS, NTPS 
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Appendix B: Types of Indicators on Federal Surveys 


Table B-1: Structure, Process, and Outcome Indicators on Federal Surveys (Number and 
Percent) 


Structure et Process a Outcome a 
Tate | (othe) g-3 Indicators Indicators 
Teacher Characteristics: 8 (10.1%) eee 13 (16.5%) Seinen 3 (3.8%) 
1. Employment Status 3 (3.8%) 
2. Associational Membership 1 (1.3%) 
3. Teacher Demographics 4 (5.1%) 
te oe 
Teacher Beliefs: 13 (16.5%) 
1. Job Satisfaction 1 (1.3%) 
2. School Environment 5 (6.3%) 
3. Beliefs about Students 4 (5.1%) 
4. Beliefs about Practice 3 (3.8%) 
Teacher In-Service 5 (6.3%) 
Experience: 
iat eared Development 4(5.1 %) 
xperience 
2. Job Evaluation 1 (1.5 %) 
Salary and Benefits: 8 (10.1%) 
School Characteristics: 11 (13.9 %) 
Student Characteristics: 4 (5.1 %) 
Total: 61 (77.2 %) 15 (18.9%) 3 (3.8 %) 


Note: Each indicator item was counted once, including cases where the same or similar indicator appeared in more than 
one of the surveys included in the sample. To calculate percentages, each item was divided by the total number of items, 
which was 79. 
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Appendix C: Source List 
for Educational Surveys 
Used in this Report 


The following ongoing surveys and 
questionnaires were used in creating this 
report. 


National (retrieved from NCES website) 


Common Core of Data Teacher 
Compensation Survey: School-Level Public- 
Use Data File [Measurement instrument], 
2007. https://nces.ed.gow/ccd/pdf/ 
tcs_sch_2006071a_gen.pdf 

Early Childhood Longitudinal Study: Fifth 
Grade Teacher Questionnaire: 
Kindergarten Class of 1998-1999 
[Measurement instrument], Spring 2004. 
https://nces.ed.gov/ecls/pdf/fifthgrade/ 
teacherquexform.pdf 

High School Longitudinal Study 
[Measurement instrument], 2009. 
https://nces.ed.gov/surveys/hsls09/pdf/ 
2009q_teacher.pdf 

National Assessment of Educational 
Progress: Reading Teacher Questionnaire 
Grade 8 [Measurement instrument], 2011. 
https://nces.ed.gov/nationsreportcard/sub- 
ject/tdw/pdf/instruments/ 
BQ11_Teacher_Read_G08.pdf 

Middle Grade Longitudinal Study: 
Mathematics Teacher Survey 
[Measurement instrument], 2017. 
https://surveys.nces.ed.gov/MGLS/Images/ 
MathematicsTeacherSurvey.pdf 


Appendix C 


National Teacher and Principal Survey: 
Teacher Questionnaire [Measurement 
instrument], 2016. https://nces.ed.gov/sur- 
veys/ntps/pdf/1516/Teacher_Question- 
naire_2015-16.pdf 

Schools and Staffing Survey: Teacher 
Questionnaire, 2012. https://nces.ed.gov/ 
surveys/sass/pdf/1112/SASS4A. pdf 


International 


International Computer and Information 
Literacy Study (International Association for 
the Evaluation of Educational 
Achievement). Teacher Questionnaire for 
the Main Study, 2018. https://nces.ed.gov/ 
surveys/icils/pdf/ 
icils2018ms_teacher_question- 
naire_en_us.pdf 

Programme for International Student 
Assessment: General Teacher 
Questionnaire - English [Measurement 
instrument], 2015. https://nces.ed.gov/sur- 
veys/pisa/pisa2015/questionnaires/Gener- 
al_Teacher_Q_English.html 

Progress in International Reading Literacy 
Study: Teacher Questionnaire Grade 4 
[Measurement instrument], 2016. 
https://nces.ed.gov/surveys/pirls/pdf/ 
P16_TQ_final.pdf 

Trends in International Mathematics and 
Science Study: Teacher Questionnaire 
Mathematics Grade 8 [Measurement 
instrument], 2015. https://nces.ed.gov/ 
timss/pdf/2015_8th_grade_Teacher_Ques- 
tionnaire_Math.pdf 
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Whether teacher surveys are the best means for 
developing indicators of teaching is an important 
question that we do not address here. Should 
policymakers seek to develop indicators of teaching, 
the methods for measurement and data collection is 
a critical question. Our analysis here provides a status 
report on current efforts, recognizing that future 
developments may include other measurement 
strategies. 
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